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Abstract — Compressed sensing is a novel technique where one 
can recover sparse signals from the undersampled measurements. 
In this paper, a K x N measurement matrix for compressed sens- 
ing is deterministically constructed via multiplicative character 
sequences. Precisely, a constant multiple of a cyclic shift of an M- 
ary power residue or Sidelnikov sequence is arranged as a column 
vector of the matrix, through modulating a primitive M-th root 
of unity. The Weil bound is then used to show that the matrix 
has asymptotically optimal coherence for large K and M, and to 
present a sufficient condition on the sparsity level for unique 
sparse solution. Also, the restricted isometry property (RIP) 
is statistically studied for the deterministic matrix. Numerical 
results show that the deterministic compressed sensing matrix 
guarantees reliable matching pursuit recovery performance for 
both noiseless and noisy measurements. 

Index Terms — Compressed sensing, multiplicative characters, 
power residue sequences, restricted isometry property, Sidelnikov 
sequences, Weil bound. 

I. Introduction 

Compressed sensing (or compressive sampling) is a novel 
and emerging technology with a variety of applications in 
imaging, data compression, and communications. In com- 
pressed sensing, one can recover sparse signals of high 
dimension from few measurements that were believed to 
be incomplete. Mathematically, measuring an iV-dimensional 
signal x £ M. N with a K x N measurement matrix A produces 
a if -dimensional vector y = Ax in compressed sensing, 
where K < N . In recovering x, it seems impossible to solve 
K linear equations with N indeterminates by basic linear 
algebra. However, imposing an additional requirement that x 
is s-sparse or the number of nonzero entries in x is at most s, 
one can recover x exactly with high probability by solving the 
li -minimization problem, which is computationally tractable. 

Many research activities have been triggered on theory 
and practice of compressed sensing since Donoho [Q, and 
Candes, Romberg, and Tao 12|[3 | published their marvelous 
theoretical works. The efforts revealed that a measurement 
matrix A plays a crucial role in recovery of s-sparse signals. 
In particular, Candes and Tao Q presented the restricted 
isometry property (RIP), a sufficient condition for the matrix to 
guarantee sparse recovery. A random matrix has been widely 
studied for satisfying the RIP, where the entries are generated 
by a probability distribution such as the Gaussian or Bernoulli 
process, or from randomly chosen partial Fourier ensembles. 



Although a random matrix has many theoretical benefits |4|, 
it has the drawbacks (5) of high complexity, large storage, 
and low efficiency in its practical implementation. As an 
alternative, we may consider a deterministic matrix, where 
well known codes and sequences have been employed for the 
construction, e.g., chirp sequences (6), Kerdock and Delsarte- 
Goethals codes 0, second order Reed-Muller codes (8), 
and dual BCH codes |9). Other techniques for deterministic 
construction, based on finite fields, representation theory, 
additive characters, and cyclic difference sets, can be found 
in ED -04]. Although it is difficult to check the RIP and the 
theoretical recovery bounds are worse than that of a random 
matrix [4], deterministic matrices guarantee reliable recovery 
performance in a statistical sense, allowing fast processing and 
low complexity. 

To enjoy the benefits of deterministic construction, this 
paper presents how to construct a K x N measurement 
matrix for compressed sensing via multiplicative character 
sequences. Precisely, we construct the matrix where a constant 
multiple of a cyclic shift of an M-ary power residue or 
Sidelnikov sequence of length K is arranged as a column 
vector, through modulating a primitive M-th root of unity. 
The Weil bound is then used to show that the matrix has 
asymptotically optimal coherence for large K and M, and to 
present the theoretical bound on the sparsity level for unique 
sparse solution. The RIP of the matrix is also analyzed through 
the eigenvalue statistics of the Gram matrices as in and ||6). 
Through numerical results, we observe that the matching 
pursuit recovery for our deterministic matrices provides stable 
and reliable performance in recovering sparse signals with or 
without measurement noise. 

The rest of this paper is organized as follows. In Section 
II, we describe the background for understanding this work. 
Section III presents the main contribution of this paper by 
constructing compressed sensing matrices from multiplicative 
character sequences, and studying the properties on sparse 
recovery. In Section IV, numerical results of the recovery 
performance are given for noiseless and noisy measurements. 
Concluding remarks will be given in Section V. 

II. Preliminaries 
The following notations will be used throughout this paper. 



UJ M 
j = 

F„ = 



= e J m is a primitive Af-th root of unity, where 
J-l. 

GF(g) is the finite field with q elements and F* = 
F q \ {0} denotes the multiplicative group of F 9 . 
F q [x] is the polynomial ring over ¥ q , where each coef- 
ficient of f(x) € ¥ q [x) is an element of ¥ q . 
For x in ¥ q , a logarithm over ¥ q is defined by 



if x 
if x 



0<t<q-2, 







where a is a primitive element in F g . 

A. Multiplicative characters 

Definition 1: Let a be a primitive element in ¥ q and M a 
divisor of q — 1, i.e., M | g — 1, We define a multiplicative 
character of F g of order M by 



= exp j 



.27r log a x 
M 
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(l) 



where V'(O) = 1 by the definition of the log operation. 



For the original definition of multiplicative characters, see 
02). In (Q~|i, note that tp(Q) = 1, which contradicts the 
conventional assumption in |[T5l . In this paper, however, we 
keep the assumption of ip(0) = 1 to maintain the definition of 
(|T), which is convenient for this work. Throughout this paper, 
ip{x) may be denoted as ip if the context is clear. 

The Weil bound [ 16) gives an upper bound on the magnitude 
of multiplicative character sums. We introduce the refined ver- 
sion (Corollary 1 in IfTTl ) supporting the assumption ip(0) = 1. 

Proposition 1: IfTTl Let fx(x),--- , fi(x) be I monic and 
irreducible polynomials in ¥ q [x] which have positive degrees 
di, ■ ■ ■ ,di, respectively. Let d be the number of distinct roots 
of f(x) = Y[ l i=ifi( x ) m i ts splitting field over ¥ q . Then, 
d < Y^i=i^i' wnere the equality is achieved if fi(x)'s 
are distinct. Let ipi ? ' ' ' > be multiplicative characters of 
F q . Assume that the product character Y[\=i ^iifii?)) is 
nontrivial, i.e., n!=i 'M/j( :r )) 7^ 1 f° r some x <G ¥ q . Let a be 
the number of distinct roots in ¥ q of fi(x), where i = 1, • • • , I. 
If ipi(0) = 1 for each i, then for every aj € F*, i = 1, ■ • • , I, 
we have 



X! ^i(oi/i(a:)) • • • ipi(aifi(x)) 



x£F„ 



< (d-l)^q + J^ei 

i=l 



(2) 

In Proposition [T] d in (f2]i can be replaced by J^i=i since 
<i < 2i=i The replacement allows us to have no need 
of distinguishing whether or not the polynomials are distinct, 
which is useful for this work. 

B. Restricted isometry property 

The restricted isometry property (RIP) [3 | presents a suf- 
ficient condition for a measurement matrix A to guarantee 
unique sparse recovery. 



Definition 2: The restricted isometry constant S s of a KxN 
matrix A is defined as the smallest number such that 



(l-*.)||x||? ' <||Ax||? <(l + 5 s )||x| 



holds for all s-sparse vectors x € 



where llxll? = 



E 



N-l 

n=0 



| 2 with x = (x , ■ • • , xjv-i) 



We say that A obeys the RIP of order s if S s is reasonably 
small, not close to 1. In fact, the RIP requires that all subsets 
of s columns taken from the measurement matrix should be 
nearly orthogonal lfl"8l . Indeed, Candes |[T9l asserted that if 
52s < 1, a unique s-sparse solution is guaranteed by Iq- 
minimization, which is however a hard combinatorial problem. 

A tractable approach for sparse recovery is to solve the 
li -minimization, i.e., to find a solution of minx 6R w Hx]^ 
subject to Ax = y, where HxH^ = Eilo 1 I n addition, 
greedy algorithms J201 have been also proposed for sparse 
signal recovery, including matching pursuit (MP) J2T), or- 
thogonal matching pursuit (OMP) J22), and CoSaMP l23l . 
If a deterministic measurement matrix is used, its structure 
may be exploited to develop a reconstruction algorithm for 
sparse signal recovery, providing fast processing and low 
complexity 16)0. 

C. Coherence and redundancy 

In compressed sensing, a K x N deterministic matrix A 
is associated with two geometric quantities, coherence and 
redundancy ll24l . The coherence p is defined by 



max a 7 

0<l^m<N-l ' 



where a* denotes a column vector of A with ||a*||j 2 = 1, 
and is its conjugate transpose. In fact, the coherence is 
a measure of mutual orthogonality among columns, and the 
small coherence is desired for good sparse recovery ||4). In 
general, the coherence is lower bounded by 



' N-K 
K(N - 1) 



which is called the Welch bound 

The redundancy, on the other hand, is defined as p = ||A|| 2 , 
where || • || denotes the spectral norm of A, or the largest 
singular value of A. We have p > N/K, where the equality 
holds if and only if A is a tight frame (26). For unique sparse 
recovery, it is also desired that A should be a tight frame with 
the smallest redundancy l26l . 

III. Compressed Sensing Matrices from 
Multiplicative Character Sequences 

Sidelnikov l27ll introduced two types of polyphase se- 
quences with low periodic autocorrelation. In what follows, we 
define the sequences by logarithm and construct compressed 
sensing matrices using the sequences. 



A. Construction from power residue sequences 

Definition 3: Let p be an odd prime and M a divisor of 
p — 1, i.e., M | p — 1. Let a be a primitive root modulo p. An 
M-ary power residue sequence r = {r(k) | < k < p — 1} 
of period p is defined by 



r(k) = log Q fc mod M. 



(3) 



By ([TJ and the modulated sequence of r(k) is represented 
by 



rlk) 



tp(k), 0<k<p-l 



where ip(0) = 1. 



Employing the power residue sequence, we construct a 
compressed sensing matrix. 

Construction 1: Let r = {r(k) | < k < p — 1} be an Al- 
ary power residue sequence of period p, where M > 2. Let 
K = p and N = (M — 1)K. In a if x N matrix A, set each 
column index as n = (c— 1)K + b, where b = n mod K and 
c = [f J + 1 for < 6 < p - 1 and 1 < c < M - 1. Then, 
we construct a K x N compressed sensing matrix A where 
each entry is given by 



1 



0-k,n 



cr(k+b) _ 



<K 

< k < K 



1, < n < TV - 1 

where k + b is computed modulo p. 

Theorem 1: For the K x AT matrix A in Construction Q] 
the coherence is given by 



/' 



max 

0<n 1 ^n 2 <N- 



K 



(4) 



where a* denotes a column vector of A. In particular, if K and 
M are large, the coherence is asymptotically optimal achieving 
the equality of the Welch bound. 

Proof. Consider the column indices of n\ — (c\ — 1)K + bi 
and ri2 = (c2 — 1)K + 62, where n\ 7^ ri2- Set x = k £ ¥ p . 
Then, the Weil bound in Proposition Q] gives an upper bound 
on the magnitude of the inner product of a pair of columns in 
A, i.e., 



1 

K 



Y,^((x + bi)- ci )-^((x + b 2 y>: 

1P1 + &i)^>2 (x + b 2 ) 



< 



xG¥ p 

K + 2 
~K 



where ipi = %jj 01 and ip2 = ip C2 - Therefore, the coherence in 
(|4]i is immediate. For large K , p w from @. Also, the 



N — K 
K(N-l) 



equality of the Welch bound is 

-i for large M. Thus, the coherence asymptotically achieves 
the equality of the Welch bound for large K and M 



M-2 
(M-l)A'-l 



Tropp 112011 revealed that (2s — < 1 ensures s-sparse 
signal recovery by basis pursuit (BP) and orthogonal matching 
pursuit (OMP). With the sufficient condition, Gribonval and 
Vandergheynst [28] further showed that matching pursuit (MP) 
also derives a unique solution with exponential convergence. 
Using the results, Theorem |2] provides a sufficient condition 
for the matrix A in Construction Q] 

Theorem 2: For the matrix A in Construction [T] a unique 
s-sparse solution is guaranteed by ^-minimization or greedy 
algorithms if 

1 / K 



s < 



K + 2 



1 



Proof. The upper bound on the_sparsity level is straightforward 
from the cohei 

(2s- 1)// < 1. 



from the coherence fj, = ^~^ +2 and the Tropp's condition 



B. Construction from Sidelnikov sequences 

Definition 4: Let a be a primitive element in the finite field 
F p m and M a divisor of p m — 1, where p is prime and m is a 
positive integer. An M-ary Sidelnikov sequence s = {s(k) \ 
< k < p m — 2} of period p m — 1 is defined by 



s(k) = \og a (a k + 1) mod M. 



(5) 



By ([T} and dD, the modulated sequence of s(k) is represented 
by 



s(k) 

where "0(0) = 1. 



i;(a k + l), 0<k<p r ' 



Construction 2: Let s = {s(fc) | < k < p m — 2} be an 
M-ary Sidelnikov sequence of period p rn — 1, where M > 2. 
Let K = p m -l and N = (M-i)K. In a KxN matrix A, set 
each column index asn= (c— l)K + b, where b = n mod K 
and c = [f J + 1 for < b < p m - 2 and 1 < c < M - 1. 
Then, we construct a K x N compressed sensing matrix A 
where each entry is given by 



1 



O-k.' 



cs(k+b) 
J M 



1 



< k < K 



K V 
1, < n < N 



1 



where A = a b <G F* m and k + b is computed modulo p m — 1. 

Theorem 3: For the KxN matrix A in Construction [2] 
the coherence is given by 



H = 



max 

0<rti^Ti 2 <A r -l 



\ZiTTT + 3 
K 



(6) 



where a* denotes a column vector of A. For large K and M, 
the coherence is asymptotically optimal achieving the equality 
of the Welch bound. 

Proof. Consider the column indices of n\ = (ci — 1)K + b\ 
and ri2 = (C2 — l)if + b 2 , where n\ 7^ n 2 . Let Ai = a , 
□ A 2 = a b2 , and x = a k e F* m . Using the Weil bound in 



TABLE I 

The spectral norms of A and A 



( If AT 
(K,I\, M) 
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/ AT l If 


(43, 1763, 42) 


6.6282 


6.4031 


(26,650,26) 


5.0990 


5 


(59, 3363, 58) 


7.7431 


7.5498 


(48, 2256, 48) 


6.9282 


6.8557 


(67, 4355, 66) 


8.2439 


8.0623 


(80,6320,80) 


8.9443 


8.8882 


(83,6723,82) 


9.1635 


9 


(124, 15252, 124) 


11.1355 


11.0905 


(97,9215,96) 


9.8982 


9.7468 


(168,28056, 168) 


12.9615 


12.9228 



Proposition [TJ the inner product of a pair of columns in A 
has the magnitude bounded by 



1 

K 
1 

K 



1 

K 



J2 i> ((\ix + 1)- C1 ) -V((A 2 x + l 
4>i (An + 1) ^2 (Mx + 1 

p m 

^2 V»i (Aix + 1) tp 2 (A 2 a; + 1 



+ 1 



< 



yx+T+3 

K 



where V'l = V J Cl an d ^2 = V" C2 - Therefore, the coherence in 
© is immediate. Similar to the approach made in the proof of 
Theorem[TJ the coherence asymptotically achieves the equality 
of the Welch bound for large K and M. □ 

With the coherence and the Tropp's sufficient condi- 
tion 1201 , the sparsity bound of A is straightforward. 

Theorem 4: For the matrix A in Construction [2] a unique 
s-sparse solution is guaranteed by l\ -minimization or greedy 
algorithms if 

1 / K 



s < 



2 \VK+l+3 



1 



Remark 1: In Constructions [TJ and [2] it is easily checked 
that a pair of rows in the matrix A (or A) may not be mutually 
orthogonal, which implies that A (or A) is not a tight frame. 
However, numerical data reveals that their spectral norms are 
nearly optimal, as shown in Table U for some values of K,N, 
and M. 

Remark 2: In Constructions [TJ and |2] each column vector of 
A (or A) is equivalent to a modulated sequence of a constant 
multiple of a cyclic shift of a power residue or Sidelnikov 
sequence. Therefore, only a single base sequence is required 
for the implementation of the compressed sensing matrix, 
which allows low complexity and storage. In particular, if m is 
even, we can generate a Sidelnikov sequence of period p m — 1 
using an efficient linear feedback shift register (LFSR) l29l . 
which further reduces the implementation complexity. More- 
over, the alphabet size M of the matrix is variable depending 



on the signal dimension N, as N is a function of M in the 
constructions. In summary, we can efficiently implement a 
variety of compressed sensing matrices with various alphabet 
and column sizes from multiplicative character sequences. 

C. RIP analysis 

For statistical RIP analysis, we chose (K, N, M) = 
(47,2115,46) for power residue sensing matrix A, and 
(K,N,M) = (48,2256,48) for Sidelnikov sensing matrix 
A, respectively. For each matrix, taking its submatrix with 
randomly chosen s columns, we then measured the condition 
number, defined as the ratio of the largest singular value of 
each submatrix to the smallest. 

In Figure [TJ we measured the means and standard deviations 
of the condition numbers of A s , A s , and G s , where A s and 
A s are the submatrices of s columns randomly chosen from 
A and A, respectively, while G s is a K x s Gaussian random 
matrix with K = 48. The statistics were measured over 
total 10,000 condition numbers, where each matrix is newly 
chosen at each instance. Each entry of the Gaussian matrix 
G s is independently sampled from the Gaussian distribution 
of zero mean and variance j^, and each column vector is then 
normalized such that it has unit / 2 - norm - 

Note that the singular values of A s (or A s ) are the square 
roots of eigenvalues of the Gram matrix A^A S (or A^A S ). 
Then, the condition numbers should be as small as possible 
for sparse signal recovery, since the RIP requires that the 
Gram matrix should have all the eigenvalues in an interval 
[1 — S s ,l + 5 8 ] with reasonably small S s 0). From this 
point of view, we see that the power residue and Sidelnikov 
sensing matrices show better statistics of condition numbers 
than the Gaussian random matrix in Figure [TJ We made similar 
observations in the statistics of power residue sensing matrix 
with (K, N, M) = (127, 15875, 126) and Sidelnikov matrix 
with (K,N,M) = (124,15252,124). This convinces us that 
A and A in Constructions [TJ and [2] are suitable for compressed 
sensing in a statistical sense. 

IV. Recovery performance 

A. Recovery from noiseless data 

Figure [2] shows numerical results on successful recovery 
rates of s-sparse signals measured by power residue sensing 
matrix A with (K, N, M) = (47,2115,46), and Sidelnikov 
matrix A with (K, N, M) = (48,2256,48), respectively, 
where total 2000 sample vectors were tested for each sparsity 



- Power residue, (K. JV) = (47, 2115) 

- Sidelnikov, (A', N) = (48, 2256) 

- Gaussian, (ft*, JV) = (48, 2256) 
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Fig. 1 . Condition number statistics of the Gram matrices of power residue, 
Sidelnikov, and Gaussian random sensing matrices. 



Fig. 2. Successful recovery rates for power residue, Sidelnikov, and partial 
Fourier sensing matrices for noiseless sparse signals. 



level. For comparison, the figure also displays the rate for 
48 x 2256 randomly chosen partial Fourier matrix, where a new 
matrix is used at each instance of an s-sparse signal, in order 
to obtain the average rate. For all the matrices, the matching 
pursuit recovery with 100 iterations has been applied for the 
reconstruction of sparse signals. Each nonzero entry of an s- 
sparse signal x has the magnitude of 1, where its position and 
sign are chosen uniformly at random. A success is declared 
in the reconstruction if the squared error is reasonably small 
for the estimate x, i.e., ||x — x||^ < 10 -4 . 

In the figure, we observe that if s < 3, more than 
99% of ,s-sparse signals are successfully recovered for the 
power residue sensing matrix, which statistically verifies the 
sufficient condition in Theorem [2] Similarly, the sufficient 
condition of the Sidelnikov sensing matrix in Theorem 0] 
is also verified for s < 2. In fact, the figure reveals that 
the sufficient conditions are somewhat pessimistic, since the 
actual recovery performance is fairly good even for high 
sparsity levels. For example, both sensing matrices guarantee 
more than 95% successful recovery rates if s < 4. Further- 
more, the matrices present better recovery performance than 
randomly chosen partial Fourier matrices. We made similar 
observations in the recovery performance of other power 
residue ((K, N, M) = (127,15875,126)) and Sidelnikov 
{{K, N, M) = (124, 15252, 124)) sensing matrices. 

B. Recovery from noisy data 

In practice, a measured signal y contains noise, i.e., y = 



Ax + z, where z £ 



'if 



denotes a ft'-dimensional complex 



vector of noise. Thus, a compressed sensing matrix must be 
robust to the measurement noise for stable and noise resilient 
recovery. Figure [3] displays the matching pursuit recovery 
performance of various compressed sensing matrices in the 
presence of noise. The matrix parameters and the sparse signal 
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Fig. 3. Successful recovery rates for power residue, Sidelnikov, and partial 
Fourier sensing matrices in the presence of noise. ((K, N) = (47, 2115) for 
power residue and (K, N) = (48, 2256) for the others) 



generation are identical to those of noiseless case. In the figure, 

x is s-spare for s = 1,2,3, and the signal-to-noise ratio 

II Axil?. 



(SNR) is defined by SNR 



where each element of 



z is an independent and identically distributed (i.i.d.) complex 
Gaussian random process with zero mean and variance a 2 z . In 
noisy recovery, a success is declared if ||x— x||j < 10~ 2 after 
100 iterations. From Figure [3] we observe that the recovery 
performance is stable and robust against noise corruption at 
sufficiently high SNR, which is similar to that of randomly 
chosen partial Fourier matrices. 



V. Conclusion 

This paper has presented how to deterministically construct 
a K x TV measurement matrix for compressed sensing via 
multiplicative character sequences. We showed that the ma- 
trices from M-ary power residue and Sidelnikov sequences 
have asymptotically optimal coherence for large K and M. 
We also presented the sufficient conditions on the sparsity 
level for unique sparse solution. Furthermore, the RIP of the 
matrices has been statistically analyzed, where we observed 
that they have better condition number statistics than Gaussian 
random matrices. Numerical results revealed that the com- 
pressed sensing matrices show stable and reliable performance 
in matching pursuit recovery for sparse signals with or without 
measurement noise. Finally, we would like to mention that 
the compressed sensing matrices can be implemented with 
small storage and low complexity, as each column vector is 
equivalently generated by a constant multiple of a cyclic shift 
of a single base power residue or Sidelinikov sequence. 
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